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3 A recipe of the F-method ^ 

1 Introduction 

The aim of this article is to give a brief account of a method that helps us 
to find a closed formula of highest weight vectors in the branching laws of 
certain generalized Verma modules, or equivalently, to construct explicitly 
equivariant differential operators from generalized flag varieties to subvari- 
eties. 

This method, which we call the F-method, transfers an algebraic problem 
of finding explicit highest weight vectors to an analytic problem of solving 
differential equations (of second order) via the algebraic Fourier transform of 
operators (Definition j3.1| ). A part of the ideas of the F- method has grown in 
a detailed analysis of the Schrodinger model of the minimal representation 
of indefinite orthogonal groups ||. 

The F-method provides a conceptual understanding of some natural dif- 
ferential operators which were previously found by a combinatorial approach 
based on recurrence formulas. Typical examples that we have in mind are 
the Rankin-Cohen bidifferential operators 
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in automorphic form theory [Q, [3], |Tl|, and Juhl's conformally equivariant 
operators [|f from C°°(R n ) to C^iW 1 - 1 ): 
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These examples can be reconstructed by the F-method by using a special 
case of the fundamental differential operators, which are commuting family 
of second order differential operators on the isotropic cone, see || (1.1.3)]. 

In recent joint works with B. 0rsted, M. Pevzner, P. Somberg and V. Soucek 
fH, [H| , we have developed the F- method to more general settings, and have 



found new explicit formulas of equivariant differential operators in parabolic 
geometry, and also have obtained a generalization of the Rankin-Cohen op- 
erators. To find those nice settings where the F-method works well, we 
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can apply the general theory || that assures discretely decomposable and 
multiplicity-free restrictions of representations to reductive subalgebras. 

The author expresses his sincere gratitude to the organizers, J. Chris- 
tensen, F. Gonzalez and T. Quinto, for their warm hospitality during the 
conference in honor of Professor Helgason for his 85th birthday in Boston 
2012. The final manuscript was prepared when the author was visiting IHES. 

2 Preliminaries 

2.1 Induced modules 

Let g be a Lie algebra over C, and U(g) its universal enveloping algebra. 
Suppose that f) is a subalgebra of q and V is an f)-module. We define the 
induced [/(g)-module by 

ind*(V) := U(g) ® u(t)) V. 

If f) is a Borel subalgebra and if dim c V = 1, then indj|(V) is the standard 
Verma module. 

2.2 Extended notion of differential operators 

We understand clearly the notion of differential operators between two vector 
bundles over the same base manifold. We extend this notion in a more general 
setting where there is a morphism between two base manifolds. 

Definition 2.1. Let Vx X and My Y be two vector bundles with a 
smooth map p : Y -> X between the base manifolds. Denote by C°°(X, Vx) 
and C°°(Y, Wy) the spaces of smooth sections to the vector bundles. We say 
that a linear map T : C°°(X, Vx) C°°(Y,>Vy) is a differential operator if 
there exists a differential operator Q acting on sections of the vector bundle 
over Y such that the following diagram commutes: 

C~(Y,p*Vx) 
p* 

C°° (X, V x ) C°°(Y,W Y ). 
We write Diff(Vx, Wy) for the vector space of such differential operators. 
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2.3 Equivariant differential operators 

Let G be a real Lie group, g(R) = Lie(G) and g = g(M) ® C. Analogous 
notations will be applied to other Lie groups denoted by uppercase Roman 
letters. 

Let dR be the representation of U(g) on the space C°°(G) of smooth 
complex-valued functions on G generated by the Lie algebra action: 

(2.1) (dR(A)f)(x) := l\ t J( X e tA ) for A e g(R). 

Let H be a closed subgroup of G. Given a finite dimensional representa- 
tion V of H we form a homogeneous vector bundle Vx '■= G xh V over the 
homogeneous space X := G/H. The space of smooth sections C°°(X,Vx) can 
be seen as a subspace of C°°(G) ® V. 

Let y v be the (complex linear) dual space of V. Then the (G x g)- 
invariant bilinear map C°°(G) x [7(g) -> C°°(G), (/, u) h> dR(u)f induces a 
commutative diagram of (G x g)-bilinear maps: 

C°°(G)®V xU(g)®cV^ — ► C°°(G) 

t I II 
C°°(X,Vx) xind^(^/ v ) — ► C°°(G). 

In turn, we get the following natural 0-homomorphism: 

(2.2) ind0(l/ v )^Hom G (C TC (X,Vx),^(G)). 

Next, we take a connected closed subgroup H' of if. For a finite di- 
mensional representation W of i/ 7 we form the homogeneous vector bundle 
W z -=Gx H ,W over Z := G/tf'. Taking the tensor product of Q with W, 
and collecting all [/-invariant elements, we get an injective homomorphism: 
(2.3) 

Hom 1 ,,(iy v ,ind«(y v ))^Hom G (C 00 (XVx),C 00 (Z,>V z )), if ^ D v . 

Finally, we take any closed subgroup G' containing H' and form a homo- 
geneous vector bundle Wy := G' ' x H ,W over Y := G'/H'. We note that Wy is 
obtained from Wz by restricting the base manifold Z to Y. 

Let i^y = C oa {Z,YJ z ) C°°{Y,W Y ) be the restriction map. We set 



(2.4) Dx^y(p) ■■= Rx^v o D, 
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Since there is a natural (G"-equivariant but not necessarily injective) mor- 
phism Y -*■ X, the extended notion of differential operators between Vx and 
Wy makes sense (see Definition 12.11). We then have: 



Theorem 2.2. The operator Dx-^y (see ( |2.4j) ) induces a bijection: 
(2.5) D X ^Y ■■ Hom„,(W v ,ind«(l/ v )) Diff G ,(Vx, Wy). 



Remark 2.3. We may consider a holomorphic version of Theorem [2.2| as fol- 
lows. Suppose Gc, He, G' c and H' c are connected complex Lie groups with 
Lie algebras g, t), q' and t)', and Vx c and Wy c are homogeneous holomor- 
phic vector bundles over X c := Gc/H c and Y c := G' c /H^, respectively. Then 
Theorem |2]2| implies that we have a bijection: 



(2.6) D Xc ^y c ■■ Honv(W/Vnd«(y v )) — Diffg(V^, W Yc ) 



Here Diff^ 1 denotes the space of G^-equivariant holomorphic differential op- 
erators with respect to the holomorphic map Yc -> Xc- By the universality 
of the induced module, fl2.6|) may be written as 



(2.7) D XC ^Y C : Hom g ,(ind^(iy v ),ind^(^)) — Diff^(Vx C) Wy c ). 

The isomorphism ( |2.7|) is well-known when Xc = Yc is a complex flag 



variety. The proof of Theorem ^]2| is given in [ TTJ | in the generality that 
X + Y. 



2.4 Multiplicity- free branching laws 

Theorem ^72] says that if Honi(,'(jy v , ind{|(y v )) is one-dimensional then G'- 
equivariant differential operators from Vx to Wy are unique up to scalar. 
Thus we may expect that such unique operators should have a natural mean- 
ing and would be given by a reasonably simple formula. Then we may be in- 
terested in finding systematically the examples where Hom( ) /(H /v , indjj(y v )) 
is one-dimensional. This is a special case of the branching problems that 
asks how representations decompose when restricted to subalgebras. In the 
setting where f) is a parabolic subalgebra (to be denoted by p) of a reductive 
Lie algebra q, we have the following theorem: 

Theorem 2.4. Assume the nilradical n + of p is abelian and r is an invo- 
lutive automorphism of g such that rp = p. Then for any one- dimensional 
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representation C\ of p and for any finite dimensional representation W of 
p T := {X e p : tX = X), we have 



dimHom pT (W v ,ind£((q)) < 1. 

There are two known approaches for the proof of Theorem |2.4j . One 
is geometric — to use the general theory of the visible action on complex 
manifolds [|, and the other is algebraic — to work inside the universal 
enveloping algebra [0. 



Remark 2.5. Branching laws in the setting of Theorem p.4| are explicitly 
obtained in terms of 'relative strongly orthogonal roots' on the level of the 
Grothendieck group, which becomes a direct sum decomposition when the 
parameter A of V is 'generic' or sufficiently positive, |J Theorems 8.3 and 8.4] 
or . The F- method will give a finer structure of branching laws by finding 
explicitly highest weight vectors with respective reductive subalgebras. The 
two prominent examples in Introduction, i.e. the Rankin-Cohen bidifferential 
operators and the Juhl's conformally equivariant differential operators, can 
be interpreted in the framework of the F-method as a special case of Theorem 



3 A recipe of the F-method 

The idea of the F-method is to work on the branching problem of represen- 
tations by taking the Fourier transform of the nilpotent radical. We shall 
explain this method in the complex setting where He is a parabolic sub- 



group Pc with abelian unipotent radical (see Theorem and Remark |2.3| ) 
for simplicity. A detaild proof will be given in |]TU[ (see also || for a somewhat 
different formulation and normalization). 

3.1 Weyl algebra and algebraic Fourier transform 

Let E be an n- dimensional vector space over C. The Weyl algebra T>(E) is the 
ring of holomorphic differential operators on E with polynomial coefficients. 

Definition 3.1 (algebraic Fourier transform). We define an isomorphism of 
two Weyl algebras on E and its dual space E y : 

(3.1) V(E) ^P(£ v ), rwf, 
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which is induced by 



(3.2) ,,. ?J :=A (1 S ,- SB ), 

where (z±, . . . , z n ) are coordinates on E and (Ci, • • • , Cn) are the dual coordi- 
nates on E" v . 

Remark 3.2. (1) The isomorphism ( |3.1| ) is independent of the choice of coor- 
dinates. 

(2) An alternative way to get the isomorphism or its variant is to 
use the Euclidean Fourier transform T by choosing a real form E(M) of E. 
We then have 

az ox 

as operators acting on the space S'(E V ) of Schwartz distributions. This was 
the approach taken in || . In particular, T + T ° T o J 7-1 in our normaliza- 
tion here. The advantage of our normalization ( |3.2j ) is that the commutative 
diagram in Theorem [3.5| does not involve any power of %/-T that would oth- 
erwise depend on the degrees of differential operators. As a consequence, the 
final step of the F-method (see Step 5 below) as well as actual computations 
becomes simpler. 



3.2 Infinitesimal action on principal series 

Let p = 1 + n + be a Levi decomposition of a parabolic subalgebra of q, and 
q = n + i + n + the Gelfand-Naimark decomposition. Since the following map 

n_x[xn + ^G c , (X,Z,Y) » (exp X)(exp Z)(expY) 

is a local diffeomorphism near the origin, we can define locally the projections 
p_ and p from a neighbourhood of the identity to the first and second factors 
n_ and I, respectively. Consider the following two maps: 

a:0xn_-[, (Y 1 X)~j t \ t=Q p (e tY e x ), 
/?: xn_-n_, ( Y ,X)~±\ o p_(e tY e x ). 
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We may regard /3(Y, •) as a vector field on n by the identification (3(Y,X) e 
n x T x n_. 

For [-module A on V, we set fi := A v <8> A dim n + . Since A dimn+ n + is one- 
dimensional, we can and do identify the representation space with V v . We 
inflate A and \i to p-modules by letting n + act trivially. Consider a Lie algebra 
homomorphism 

(3.3) ^: ^P(n_)(8)End(y v ), 
defined for F e C°°(n_, V v ) as 

(3.4) {d^(Y)F) (X) := fi(a(Y, X))F(X) - (p(Y, ■ )F)(X). 

If (/i,y v ) lifts to the parabolic subgroup Pc of a reductive group Gc with 
Lie algebras p and g respectively, then dn^ is the differential representation 
of the induced representation lnd p ^(V) (without p-shift). We note that the 
Lie algebra homomorphism ( |3.4|) is well-defined without integrality condition 
of \i. The F-method suggests to take the algebraic Fourier transform ( |3.1[ ) 
on the Weyl algebra D(n_). We then get another Lie algebra homomorphism 

(3.5) c^:0^£>(n + )<S>End(y v ). 
Then we have (see flOU ) 

Proposition 3.3. There is a natural isomorphism 

F c :indS(A v ) ^Pol(n + )®V^ v 
which intertwines the left g-action on U(g) <B>u(p) V v with dn^. 

3.3 Recipe of the F-method 

Our goal is to find an explicit form of a G'-intertwining differential operator 
from Vx to Wy in the upper right corner of Diagram |3.1| . Equivalently, 
what we call the F-method yields an explicit homomorphism belonging to 
Hom ,(indj;(W v ),ind£(y v )) k Hom p ,(lf v , ind£(V v )) in the lower left corner 
of Diagram |3J] in the setting that n + is abelian. 

The recipe of the F-method in this setting is stated as follows: 
Step 0. Fix a finite dimensional representation (X,V) of p = 1+ n + . 
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Step 1. Consider a representation /x := A v <8> A dimn+ n + of the Lie algebra p. 

Consider the restriction of the homomorphisms (|3.3|) and ( |3.5|) to the 
subalgebra n+: 

rf7r M :n + -> P(n_) <g>End(F v ), 
rf^:n + -> P(n + ) ®End(F v ). 

Step 2. Take a finite dimensional representation of the Lie algebra p'. For 
the existence of nontrivial solutions in Step 3 below, it is necessary and 
sufficient for W to satisfy 

(3.6) Hom ,(indJ(V^ v ),indS(F v )) * {0}. 

Choose W satisfying ( |3.6|) if we know a priori an abstract branching 
law of the restriction of indp(V v ) to g'. See || Theorems 8.3 and 8.4] 
or for some general formulae. Otherwise, we take W to be any 
I'-irreducible component of >S(n + ) ® V v and go to Step 3. 

Step 3. Consider the system of partial differential equations for ijj € Pol(n + ) ® 
V y ® W which is ['-invariant under the diagonal action: 

(3.7) d^(C)^j = for C eti^. 



Notice that the equations (|3.7|) are of second order. The solution space 



will be one-dimensional if we have chosen W in Step 2 such that 
(3.8) dimHom g ,(indJ(iy v ),indS(y v )) = 1. 



Step 4. Use invariant theory and reduce (|3.71) to another system of differential 
equations on a lower dimensional space S. Solve it. 



Step 5. Let tp be a polynomial solution to (3/7) obtained in Step 4. Compute 



(Symb®Id) Here the symbol map 

Symb : Diff const (n_) ^> Pol(n + ) 
is a ring isomorphism given by the coordinates 

OZi OZ n OZj 
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In case the Lie algebra representation (A, V) lifts to a group Pc, we form a 
Gc-equivariant holomorphic vector bundle Vx c over X c = Gc/Pc- Likewise, 
in case W lifts to a group P c , we form a G^-equivariant holomorphic vector 
bundle Wy c over Yc = G' c / 'P c . Then (Symb ® Id) _1 (-0) in Step 5 gives an 
explicit formula of a G^-equivariant differential operator from Vx c to Wy c in 



the coordinates of n_ owing to Theorem |3.5| below. This is what we wanted. 
Remark 3.4. In Step 2 we can find all such W if we know a priori (abstract) 
explicit branching laws. This is the case, e.g., in the setting of Theorem |2.4| . 
See Remark 

Conversely, the differential equations in Step 3 sometimes give a useful 
information on branching laws even when the restrictions are not completely 
reducible, see ||. 

For concrete constructions of equivariant differential operators by using 
the F-method in various geometric settings, we refer to |], 10]. A further 



application of the F-method to the construction of non-local operators will 
be discussed in another paper. 

The key tool for the F-method is summarized as: 

Theorem 3.5 (]|10j)- Let P^ be a parabolic subgroup of G' c compatible with 
a parabolic subgroup Pc of Gc- Assume further the nilradical n+ of p is 
abelian. Then the following diagram commutes: 

Symb ®Id 

Rom c (W\ind B p (V^)) k Pol(n + ) ® Eom c (V, W) ^- Diff const (n_) ® Hom c (y, W) 
u O u 

Hom p , ( W- , ind£ (V v )) Diff G > c (V Xc ,Wy c ). 

Diagram 3.1 
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